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DETAILED ACTION 
Arguments and Amendments 

1. Applicant's amendments and arguments filed 6 December 2004, have been entered and 
made of record. 



Response to Amendments and Arguments 

2. Applicant argues that the combination of Gupta and Leclerc is invalid for claims 1 and 7 
because Gupta and Leclerc are related to non-analogous arts. See Applicant's Remarks, pp. 11- 
13. 

In response, Examiner maintains that Gupta and Leclerc do encompass related arts, and 
the combination is valid. It has been held that a prior art reference must either be in the field of 
applicant's endeavor or, if not, then be reasonably pertinent to the particular problem with which 
the applicant was concerned, in order to be relied upon as a basis for rejection of the claimed 
invention. Sec In re Oetiker, 977 F.2d 1443, 24 USPQ2d 1443 (Fed. Cir. 1992). 

In this case, Leclerc is both in the field of Applicant's endeavor (image processing) and is 
reasonably pertinent to the particular problem with which the applicant was concerned (manually 
designating objects of interest in an image when automatic detection methods fail). Leclerc does 
not disclose the specific task of detecting red-eyes in an image, but only Leclerc' s broad teaching 
- that it was conventional to have a user manually designate objects in an image when automatic 
detection methods fail - was relied upon for the combination. 

Applicant also alleges that Leclerc teaches away from manual operation as recited in the 
claim because Leclerc discloses that the manual usage should be "ruled out for common use as it 
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calls for a competent operator and requires time which a user often lacks" (Applicant's Remarks, 
p. 13). However, it should be noted that Leclerc does not "teach away from any sort of manual 
operation." Rather, Leclerc merely states that manual operation should not be commonly 
employed because it is a strain on the user's time and requires a user with expertise. The manual 
operation was described by Leclerc to communicate that manual designation was conventional in 
the art relating to object detection. Leclerc is relied upon only for the conventional wisdom that 
when automated processes for the detection of objects in an image fail, intervention by a human 
operator becomes necessary. 

3. Regarding claims 25 and 27, Applicant alleges that Gupta does not disclose, "some sort 
of fine scanning of the user-selected area." See Applicant's Remarks, p. 14. 

However, as Gupta discloses, "[cjandidate areas within the user-selected area of the 
image are then automatically identified" (column 3, lines 18-19). In other words, the user- 
selected areas are finely scanned (i.e. searched, examined, or analyzed, etc.) designate a more 
precise red-eye region. Therefore, Gupta is considered to teach the imitations of "prescanning" 
and "fine scanning," as claimed. 

Claim Rejections - 35 USC § 103 

4. The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

5. Claims 1, 2-5, 7-11, 13, and 23-27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent 6,204,858 by Gupta in view of U.S. Patent 5,048,103 by Leclerc et 
al. ("Leclerc"). 
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Regarding claims 1 and 7, Gupta discloses a method (figure 4) of setting a region to be 
adjusted to redeye correction in which a redeye in an image that has been produced in shooting is 
corrected into an eye having a pupil of a specified color, comprising the steps of: 

automatically extracting only the redeye from a first region including the redeye which 
has preliminarily been designated by an operator or automatically (a user designates a first area 
("first region") at step 410 and then a candidate area (which is assumed to contain only a redeye) 
is automatically extracted from the first area; column 3, lines 12-26); and 

setting a second region to be subjected to redeye correction for correcting a color of the 
pupil into said specified color of the pupil (step 420: the extracted candidate area, which contains 
a redeye, is set as a "second region" for pupil-color correction). 

Further regarding claim 7, Gupta discloses converting the second region into the eye 
having the pupil of said specified color to correct the redeye (figure 9). 

Gupta discloses prompting the user to verify whether the automatic extracting step 
successfully extracted an actual redeye region (430, figure 4). 

However, Gupta is silent to setting the second region manually in case the redeye cannot 
be extracted automatically, as claimed. 

Leclerc discloses a method for the automatic resetting of images. In the background 
section, Leclrec poses the problem of aligning two medical images. Leclerc establishes that the 
prior art facilitates the alignment by detecting various landmarks in the images. Then, distortion 
of the images is corrected according to the observed distortion in the landmarks. Column 1, line 
62 through column 2, line 7. 
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Leclerc identifies a problem associated with identifying the landmarks automatically: "In 
practice, automatic methods fail at the stage for selecting and the stage for validating the 
landmarks." Column 2, lines 46-48. When the automatic detection of landmarks fails, Leclerc 
discloses that the selection and validation is performed manually. Column 2, lines 48-52. 

Thus Leclerc discloses the conventional concept of having a user manually designate 
objects of interest in an image when automatic detection methods fail. 

Although Leclrec's disclosure is directed to a different invention than that of Gupta, both 
Gupta and Leclerc are related to the field of image processing, and more specifically, they are 
both concerned with extracting objects of interest from an image. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta by Leclerc to set the second region manually in case the automatic extraction 
fails since Leclerc discloses that, conventionally, objects of interest in an image are 
automatically extracted, but when automatic extraction fails, the user performs manual 
designation. 

Regarding claims 2 and 8, Gupta discloses that the first region is a rectangular frame 
surrounding an eye (column 3, lines 12-17). 

Regarding claims 3 and 9, Gupta discloses the image frame is designated as said first 
region using shooting information (i.e. the frame is designated using the image's content, or 
"shooting information"). 
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Regarding claims 4 and 10, Gupta discloses at least one of each eye can be designated by 
designating one eye by means of enclosing the eye with an area in a rectangular shape (column 3, 
lines 12-17). 

Regarding claims 5 and 11, Gupta discloses the setting step of said second region is 
performed on image data which has been subjected to color adjustment (column 3, lines 27-34). 

Regarding claim 13, Gupta discloses setting the second region and performing the redeye 
correction on an RGB color image (which has been shot as a color image). Gupta does not 
disclose converting the corrected color image into a monochrome image for output. However, at 
the time of the invention, converting an RBG image to a monochrome image was well-known 
and it would have been obvious to those skilled in the art to convert the color image into 
monochrome for the purposes of saving storage space, or for viewing the image in one color, or 
for printing in grayscale, etc. 

Regarding claims 23 and 26, Gupta discloses judging, as claimed (430, figure 4). 

Regarding claim 24, the combination of Gupta and Leclerc discloses judging to 
determine if the redeye region has been automatically extracted (430, figure 4 of Gupta) and then 
setting the second region manually if the automatic extraction has failed (column 2, lines 46-52 
of Leclerc). 

Regarding claims 25 and 27, Gupta discloses a user prescans the image to designate the 
first region (column 3, lines 12-17) and then the system finely scans the image to form the 
second region corresponding to the candidate area (column 3, lines 18-26). That is, the user 
prescans the image visually to obtain a first region, then the system electronically scans the 
image finely to acquire the second region. 
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6. Claims 6 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over Gupta in 
view of Leclerc, and further in view of U.S. Patent 6,009,209 by Acker et al. ("Acker"). 

Regarding claim 6 and 12, Gupta is silent to the claimed limitations. 

Acker discloses a similar redeye correction system. In particular, Acker discloses that 
when a redeye region is set, a position of the redeye is roughly designated in a verification screen 
(i.e. the position of the redeye is shown on a display: figure 2 A and column 6, lines 7-11; and the 
area of the redeye is roughly designated so that it may be zoomed in on) for determining an 
image processing condition including at least one of color and density (i.e. the "conditions" (e.g. 
the areas) of the redeye processing are determined by the displayed region of the redeye), a 
display screen is replaced with an output image and thereafter setting said second region is 
performed (i.e. the zoomed image on the screen replaces the original image, and the user sets the 
second region). 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta and Leclerc by Acker to roughly designate the position of the redeye on the 
screen and replace the screen with a an output image, as claimed, since displaying the image and 
region-setting results to a user facilitates the redeye designation process. 

7. Claims 14-22 and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Gupta and Leclerc, as applied to claim 7 above, and further in view of U.S. Patent 5,432,863 by 
Benati et al. ("Benati"). 
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Regarding claim 14, Gupta is silent to the redeye designation by setting said second 
region being performed on first image data while said redeye correction being performed on 
second image data, as claimed. 

Benati discloses a similar redeye detection/correction system. In particular, Benati 
teaches detecting the redeye region in a first image, and then correcting the redeye region in a 
second image, based on the location of the redeye in the first image. Figure 3 shows the detection 
phase 200 is performed on the input image 100. Figure 4 shows that the input image is converted 
into a lower (310) or higher (330) resolution image on which redeye correction (380) is 
performed. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta and Leclerc by Benati to achieve the claimed invention since Benati teaches 
that "one might wish to perform the [redeye] detection phase in some image resolution, but 
perform the fix phase in another" (column 7, lines 30-32). 

» 

Regarding claims 15-17, Benati teaches the first image has fewer bits, is smaller, and has 
lower resolution than the second image (i.e. the second image has higher resolution (figure 4, 
330), and therefore has more bits and is larger). 

Regarding claim 18, Benati discloses that said first image data is image data of a partial 
image of an image represented by said second image data (i.e. the first image is a representation 
of the second image, therefore, the first image data is at least "a partial image of an image 
represented by said second image data"). 

Regarding claim 19, Benati discloses that the second image data is produced from the 
first image data (i.e. the second image is a lower- or higher-resolution version of the first image). 
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Regarding claim 20, Benati teaches the first image data is a prescanned image (i.e. the 
first image was scanned by a scanner 10 (figure 1) at some resolution) whereas said second 
image data is fine scanned image data (i.e. the second image is fine scanned image data, which is 
at a higher resolution (column 7, lines 49-51)). 

Regarding claim 21, Benati discloses the redeye designation is performed on said first 
image data (200, figure 2) and the redeye correction is performed on said second image data 
(380, figure 4), said result of the redeye designation is reserved separately from said first image 
data and thereafter utilized for said second image data (Benati creates, from the input image, a 
binary bitmap that designates the location of only the defective pixels; the result of the 
designation is then utilized for the second image data to denote which pixels are to be corrected; 
column 4, lines 29-42). 

Regarding claim 22, Benati discloses the redeye designation information is at least one of 
redeye position information and redeye region information (e.g. figure 9 shows bitmaps which 
designate the position of the redeye). 

Regarding claim 32, Gupta is silent to the shooting information being determined from a 
magnetic recording formed on a film. 

Benati discloses a similar redeye correction system. In particular, Benati discloses 
digitizing (10, figure 1) an image formed on film using a camera in order to digitally correct the 
image. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta and Leclerc by Benati to determine the shooting information (i.e. image 
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content) from a magnetic recording, since Benati shows that images are conventionally captured 
onto film and then converted into digital images for redeye processing. 

Regarding claim 35, Benati discloses the first and second image data are image data of 
said image having said red eye that has been produced in shooting (figure 1 : the image data is 
created from a scanned photograph). 

8. Claims 30 and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over Gupta 
in view of Leclerc, as applied to claim 3, and further in view of U.S. Patent 6,210,048 by Tanaka 
et al. ("Tanaka"), Benati and U.S. Patent 6,407,777 by DeLuca. 

Regarding claim 30, Gupta and Leclrec are silent to the shooting information including 
information regarding whether a flash is used. 

DeLuca discloses a similar system for redeye correction. In particular, DeLuca discloses 
performing redeye correction only if certain conditions indicate the possibility of redeye being 
present (210, figure 8). One of the conditions is the usage of a flash for capturing ("shooting") 
the image (310, figure 9). 

Benati discloses a redeye correction system wherein images on film (15, figure 1) are 
converted into digital images by a scanner (10, figure 1) for the purposes of digitally correcting 
the redeye effects. 

Tanaka discloses a camera. In particular, Tanaka discloses that additional information, 
such as information on whether a flash was used, is recorded onto the film when a picture is 
taken (column 6, lines 45-49). 
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It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta and Leclerc by DeLuca, Benati and Tanaka to achieve the claimed invention by 
including information on whether a flash was used with an image recorded onto film by 
conventional means since DeLuca discloses that such information is helpful in determining 
whether redeye correction should be performed on an image, and Tanaka teaches that flash 
information is retained by recording it onto film as the picture is taken, and in order to correct an 
image taken by a conventional film-loaded camera, Benati teaches digitizing the image using a 
scanner. 

Regarding claim 31, Tanaka teaches the shooting information is recorded onto and 
determined from the film. 

9. Claims 28 and 29 are rejected under 35 U.S.C. 103(a) as being unpatentable over Gupta 
in view of Leclerc as applied to claims 27 and 7 above, and further in view of U.S. Patent 
5,986,642 by Ueda et al. ("Ueda"). 

Regarding claims 28 and 29, Gupta and Leclerc are silent to displaying the fine scanned 
image before converting next to the fine scanned image after converting, and then having the 
user select the suitable image for output. 

Ueda discloses an image processing system to aid a user in correcting an image. In 
particular, Ueda discloses displaying a corrected image (1004, figure 1) next to an original image 
(1002, figure 1). The user is then able to visually compare the corrected and uncorrected images 
and select the more desirable image for output (column 1, lines 62). 
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It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta and Leclerc by Ueda to achieve the claimed invention, since Ueda teaches that 
displaying corrected and uncorrected images adjacent to one another, and then allowing the user 
to select the more suitable image is advantageous in that it is easier for a user to adjust the color 
of an original image (column 1, lines 29-40). 

10. Claims 36 and 37 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent 6,204,858 by Gupta in view of U.S. Patent 5,048,103 by Leclerc et al. ("Leclerc"), as 
applied to claims 25 and 27, and further in view of U.S. Patent 6,252,976 by Schildkraut et al. 
("Schildkraut"). 

Regarding claims 36 and 37, Gupta discloses that the prescanning of the image to 
designate areas for adjustment are carried out by a user rather than a scanner device, as claimed. 

Schildkraut discloses a system for detecting and correcting red-eyes in digital images 
(figure 2). In particular, Schildkraut discloses that, in order to extract the red-eye areas of an 
image, skin areas are first extracted (S6), and then red-eye candidate pixel areas are extracted 
from the skin areas (SI 6), Thus, Schildkraut employs automatic preliminary designation of first 
image regions, rather than manual preliminary designation, as taught by Gupta. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify Gupta by Schildkraut to perform the prescanning of the first region automatically 
using a scanner device, rather than manually, since Schildkraut shows that prescanning an image 
to automatically designate a preliminary first region using a scanner device is substantially 
equivalent to having a user prescan the image manually to designate first regions where a red-eye 
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is potentially located. Both methods are operative to effectively extract a first region, which is 
then subject to a fine scanning to locate red-eye regions. The advantage of setting the first region 
automatically as taught by Schildkraut rather than manually as taught by Gupta would have been 
readily apparent by those skilled in the art, as making a manual process automatic is obvious per 
se. Cf In re Vernier . 262 F.2d 91, 95, 120 USPQ, 192, 194 (CCPA 1958). 



Allowable Subject Matter 
1 1 . Claims 33 and 34 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the base 
claim and any intervening claims. 

Regarding claim 33, Gupta and Leclerc are silent to setting the second region and 
correcting the redeye on first image data for display, and then setting the second region and 
correcting the redeye on a second image data for printing, as claimed. 

U.S. Patent 6,407,777 by DeLuca discloses a similar redeye correction system. As shown 
in figure 4, first image data is displayed to a user for the purposes of designating the redeye 
region and correcting the redeye. After the user presses the "remove red eye" button, the image is 
corrected and displayed. Then, the user either verifies the correction ("next eye"), or nullifies it 
("undo"). After the image is correction and verified on the display, it is printed (16) as shown in 
figure 1. 

However, DeLuca does not appear to disclose performing region-setting and redeye 
correction on first image data , which is displayed and verified, and then performing region- 
setting and redeye correction on second image data , which is printed. 
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Conclusion 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Colin M. LaRose whose telephone number is (571) 272-7423. If 
attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Amelia 
Au, can be reached on (571) 272-7414. The fax phone number for the organization where this 
application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding should 
be directed to the TC 2600 Customer Service Office whose telephone number is (571) 272-2600. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
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may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

CML 

Group Art Unit 2623 
15 April 2005 




